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We study the effects of a fourth generation t' quark in various extensions of the standard model. 
In the Randall- Sundrum model, the decay t' — > tZ has a large branching ratio that could be detected 
at the Large Hadron CoUider (LHC). We also look at the two-Higgs doublet models I, II and III, and 
note that, in the latter, the branching ratio of t' t(j>, where is a Higgs scalar or pseudoscalar, 
is huge and we discuss detection at the LHC. A few comments about the minimal supersymmetric 
standard model are also included. 
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II. RANDALL-SUNDRUM MODEL 
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Interest in a sequential fourth generation has waxed 
and waned over the years [l|, Q • Shortly after the discov- 
ery of the third generation, a fourth generation was an ob- 
vious extension. However, interest in a fourth generation 
dropped substantially after measurement of the number 
of light neutrinos at the Z pole showed that only three 
light neutrinos could exist. The discovery of neutrino os- 
cillations suggested the possibility of a mass scale beyond 
the standard model, and models with a fourth generation 
containing a sufficiently massive neutrino became accept- 
able. In the early part of this decade, it was thought 
that electroweak precision measurements ruled out a 
fourth generation, however it was subsequently pointed 
out Q that if the fourth generation masses are not de- 
generate, then these constraints can be evaded. More 
recently, Kribs et al. [1] showed that a mass splitting of 
40 — 60 GeV between the fourth generation quarks results 
in S and T parameters which are within the one-sigma 
error ellipse. 

Most analyses of the phenomenology of a sequential 
fourth generation have focused on the minimal Standard 
Model. In this paper, we consider the phenomenology 
of the fourth generation t' in popular extensions of the 
Standard Model. In Section II, we discuss the Randall- 
Sundrum model and show that one expects a relatively 
large branching ratio for the flavor-changing decay t' — *■ 
tZ, which could be detected at the LHC. In Section HI, 
we study the two-Higgs doublet models (Models I, II and 
III), and show that in Model HI, the decay t' tcj), 
where (j) is either a Higgs scalar or pseudoscalar, can have 
a huge branching ratio (as high as 95%) and we discuss 
the rather dramatic phenomenology at the LHC. Finally, 
in Section IV, we present our conclusions. 
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The Randall-Sundrum model (RSI) p is a popular so- 
lution to the hierarchy problem, where the warped geom- 
etry of an additional dimension is responsible for gener- 
ating TeV scale physics from a more fundamental Planck 
scale. In the original RSI model, the standard model 
(SM) fields were confined to the TeV brane, but it was 
quickly noted that they could be placed in the bulk with- 
out problems 0, B IH ■ This led to a natural resolution of 
the fiavor hierarchy problem. 

In the basis of diagonal bulk masses, the normalized 
wavefunction of zero- mode fermions is given by 0, d, 



k{l ~ 2c/)(fcz)(i-2c/ 
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where /? = kRi: « 37, l/k < z < e"/k and c/ is the 5-D 
mass parameter describing the location of the fermion in 
the bulk. For c/ < 1/2 (c/ > 1/2) the fermion ipf lives 
near the TeV (Planck) brane since its resulting Yukawa 
coupling with the Higgs field becomes large (small). Since 
the Kaluza-Klein (KK) modes lie near the TeV brane, the 
heavier fermions have larger couplings to KK bosons. As 
noted by Agashe et al. [To, [HI , there is mixing between 
the Z-boson and the KK-Z boson, resulting in a shift of 
the fcrmionic couplings to the Z. 

In this model, the portion of the Lagrangian responsi- 
ble for SM flavor violation is given by [ll| 
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and axial vector coefficients depend on the fermion 
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The constants // are given in terms of equation [T] by 

V2k/ff = f^^\cf,e^ /k). Lastly, ip'^p is the zero-mode 
of the 4-D fermion field in the basis of diagonal 5-D bulk 
masses. However, this basis is not the same as the basis 
in which the 4-D mass terms are diagonal. This gives 
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rise to flavor violating terms in the 4-D basis, which have 
larger couplings for heavier fermions. 

Using this formalism, Agashe et al. point out that 
with three generations, the branching ratio for t — )■ cZ is 
of 0(10"^) for a KK-Z mass of 3 TeV. This is a signifi- 
cant increase from the SM value. In the case of a fourth 
generation however, there are no electroweak precision 
constraints and so very large flavor changing neutral cur- 
rents (FCNC) are allowed. In particular, one expects to 
observe t' — > at a large rate. Due to the fact that 
the t' and the b' have nearly degenerate masses, the de- 
cay of the t' is dominated by t' — ^ Wb unless the mixing 
angle is very small. Thus the decay rate for t' — > Wb 



BR(f' -ifZ) 

O ta. - 



is proportional to \Vt 



vbV ~ l(C^/)34r, where ({//) is the 
mixing matrix that arises when expanding out the 4-D 
fermion fields from equation [5] in the basis of diagonal 
4-D mass terms. Thus the \Vt'b? factor in T{t' Wb) 
conveniently cancels the |(C//)34p factor in V{t' tZ) 
when calculating the branching ratio BR(i' tZ). 

The decay rate and branching ratio for t' tZ depend 
on the four 5-D mass parameters for the left and right 
handed t and t' . Two of these can be eliminated in favor 
of the t and t' masses. Using the central value of Ct^ 
given by Agashe [Tlj . the number of free parameters is 
reduced to the t' mass and the fermion mass parameter 
Ct'^ , which describes the location of the t' in the bulk. 

The results for the branching ratio are given in Figure 1 
for t' masses of 400 and 500 GeV. As one varies the third 
generation mass parameter ctj^ parameter (discussed in 
the previous paragraph) over a reasonable range, this re- 
sult changes by less than a factor of two. We find a 
branching ratio of ©(lO'^ - IQ-^). 

ATLAS has claimed that a bound of 10^*^ can be 
reached in 100 fb"^ for t cZ. Since the Z energy in the 
t' — > tZ decay is similar to that in t cZ, one can get 
a rough estimate of the sensitivity by simply scaling this 
by the production cross section. This gives a sensitivity 
of 10~^ for t' — > tZ. One can probably do substantially 
better if one includes the fact that the t in the decay can 
be detected, which will help eliminate backgrounds. It is 
clear that this places the decay within reach of the LHC, 
although a more precise analysis would be welcome. 

How does this branching ratio compare with other 
models? The most comprehensive study concerning 
FCNC in the four generation Standard Model is the work 
of Arhrib and Hou [l^. They considered loop induced 
FCNC decays of fourth generation quarks, plus effects 
of fourth generation quarks on FCNC decays of third 
generation quarks. They found that the decay t' — > tZ 
can occur in the standard model with a branching ratio 
of 0(10^^ — lO^"') and suggest that this may be mea- 
surable at the LHC. In the Randall-Sundrum case, the 
branching ratio will be larger by approximately a factor 
of 100. What about flavor models? We know of no such 
models for four generations. One of us (MS) is study- 
ing such a model, but the rate will be similar to that of 
Arhrib and Hou (additionally, flavor models do not typ- 
ically give large rates for t cZ). It is also likely that 
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FIG. 1: Branching Ratio for t' tZ as a. function of the 
fermion mass parameter c^/ . 



other models will have a rate for t' or t' tg which 
is comparable to t' —^ tZ, unlike the Randall-Sundrum 
case. 



III. TWO HIGGS DOUBLET MODELS 

Among the most popular extensions of the Standard 
Model are two Higgs doublet models [ij . The most com- 
mon is called Model II. In the two Higgs doublet model 
II, due to a discrete symmetry, the down-type quarks and 
leptons couple to one complex doublet (pi while the up- 
type quarks and neutrinos couple to the other ^2- The 
ratio of vacuum expectation values (vev) is a free param- 
eter defined by tan(/3) = V2/V1. By requiring that the 
theory be perturbative we obtain a bound on the possi- 
ble values of tan(/3). The Yukawa couplings of fourth 
generation quarks are given by gt'/\/2 = mt'/v2 and 
gi,,/y/2 = mi,,/vi, where v'^ = vf + v'^ = (246GeV)2. 
If we approximate rrit' ~ = M > 280 GeV and re- 
late vi and V2 to the Standard Model Higgs vev v in 
terms of tan(/3), then the theory will remain perturba- 
tive, g^, < An and g^, < Att, only if 



y/2Tr{v/ My 



< tan(/3) < ^/2^T{v/My 



1 



(3) 



Thus for Model II with M > 280 GeV we find 1/2 < 
tan(/3) < 2. In Model I the field does not couple to 
fermions, which eliminates the upper bound, the lower 
bound however remains unchanged. 

Issues of perturbation theory and vacuum stability 
pose a challenge to four-generation models. As noted 
most recently by Kribs 15], in the Standard Model the 
large Yukawa couplings will cause the scalar self-coupling 
to either go negative (leading to vacuum instability) or 
reach a Landau pole well before the GUT scale. The 
Yukawa coupling itself can also reach a Landau pole at 
relatively low scales. Although methods can be found to 
extend the reach of perturbation theory [T5| , they do in- 
volve addition of new physics just above the TeV scale. In 
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FIG. 2: Branching Ratio for t' Wb as a function of the 
ratio Mu+ /Mt' . 



the two Higgs doublet models, the situation is much more 
complicated since there are many scalar self-couplings, 
many other vacua (such as charge-breaking vacua) and 
many other opportunities for instabilities. Our approach 
here is to assume that the two Higgs doublet model is an 
effective theory below the TeV scale, and will presume 
that physics above that scale will not substantially affect 
our results. 

Since the charged Higgs is a possible decay product 
of the t' through the decay t' Hb, and this decay 
will be very difficult to observe, there will be a slight 
suppression in the branching ratio BR(t' — > Wb), which 
is shown in Figure 2 as a function of the charged Higgs 
mass. 

A much more interesting situation arises in Model HI. 
In Model III, there is no discrete symmetry prohibiting 
tree level flavor changing neutral currents. Initially this 
appears to be very problematic. However if one goes to 
a basis in which one of the scalar fields gets a vacuum 
expectation value and the other does not, then the cou- 
plings of the latter, will be, in general, flavor changing. 
By analyzing various mass matrix textures, Cheng and 
Sher [16\ argued that fine-tuning can be avoided if the 
flavor changing neutral couplings S.ijfifj(t> are given by 



v/V2 



(4) 



and the couplings A.^ are of 0(1). In other words, the 
flavor changing Yukawa couplings are the geometric mean 
of the two Yukawa couplings of the fermions involved. 
Model III is defined as the two Higgs doublet model with 
Yukawa couplings given by the above expression. Recent 
studies prj of heavy quark mixing and decays have begun 
exploring interesting regions of parameters space (which 
depends on the Ay and the relevant Higgs masses) . Note 
that in this model, the flavor changing couplings of the 
light quarks are very small, and the constraints from kaon 
physics are not as severe. Only a few studies of Model III 
have been done [H, [H, [13] involving fourth generation 
fields. 

In this Model, one would expect an enormous flavor 



changing coupling between the t', the t and the (f>. The 
coupling, in fact, would be substantially larger than the 
top quark Yukawa coupling. If kinematically accessible, 
then one would expect t' — > t(f> to overwhelmingly domi- 
nant t' decays. Here, can be the combination of neutral 
scalars that is orthogonal to the state that gets a vev, or 
it can be the pseudoscalar. In either event, this decay 
will dominate. 

The cross section for producing a 400 GeV t' is 15 pi- 
cobarns j2l|. Virtually all of these t's will decay into 
tcf), leading to a dramatic ti(j)(f) signature. If is a pseu- 
doscalar or a neutral scalar lighter than about 140 GeV, 
then it will decay into bb, leading to a 66, 2W final state. 
The biggest Standard Model background to these events 
would come from double pair production of ttbb. The 
cross section for this background [22] is approximately 2 
picobarns, and it gives a 46, 2W final state. If one only 
looks at events with three or more tagged 6's and one 
or more leptons, and assumes a 6-tag efficiency of 40%, 
then the signal will pass the cut 20% of the time, and 
the background will pass the cut 8% of the time, leading 
to a signal of 3150 fb and a background of only 160 fb. 
Thus, it appears that the signal will easily be detectable, 
possibly in an early run at the LHC. 

If (/) is a neutral scalar heavier than 140 GeV, then it 
will decay into WW leading to a 25, 6W final state. Here, 
if one looks at events with three or more leptons and one 
or more tagged 6's, then 12% of the decays will pass the 
cuts, leading to an event rate of 1.8 picobarns. We know 
of no standard model background that comes close to this 
signal. This signal would also be easily detectable at the 
LHC. 



IV. CONCLUSIONS 

There continues to be interest in the phenomenology 
of a sequential fourth generation. Yet almost all discus- 
sion have been in the context of the Standard Model. 
In this paper, we have explored the phenomenology of 
the fourth generation, focusing on the t' quark, in exten- 
sions of the Standard Model. In the Randall-Sundrum 
model, the decay t' —^ tZ can occur at a rate approach- 
ing one percent, which should be detectable at the LHC. 
In two-Higgs doublet model, one gets a suppression of 
the branching ratio t' Wb in Models I and II, but in 
Model HI the decay of t' — > tcj), where </) is a scalar or 
pseudoscalar, dominates the decay, leading to spectacu- 
lar ti(f)(j) signatures at very large rates, which could be 
detected during the early months of running at the LHC. 
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